BEST APPROXIMATION IN MAX-PLUS SEMIMODULES 



MARIANNE AKIAN, STEPHANE GAUBERT, VIOREL NITICA, 
AND IVAN SINGER 

Abstract. We establish new results concerning projectors on max-plus 
spaces, as well as separating half-spaces, and derive an explicit formula 
for the distance in Hilbert's projective metric between a point and a 
half-space over the max-plus semiring, as well as explicit descriptions of 
the set of minimizers. As a consequence, we obtain a cyclic projection 
type algorithm to solve systems of max-plus linear inequalities. 



1. Introduction 

Let 

I^max denote the so-called max-plus algebra, which is the semiring 
composed of the set M U {—00} endowed with the maximization operation 
as addition /i©i/ := max(/x, v), the usual addition as multiplication := 
II + y (also for fi = u = —00), and the neutral elements —00 and for 
addition © and multiplication ® respectively. We shall often denote the 
multiplication of Mmax by concatenation (except when the omission of the 
symbol © leads to an ambiguity). 

The space ^"^^x °f n-dimensional vectors, endowed naturally with the 
pointwise addition (denoted also by ©) and the multiplication of a vector 
by a scalar (denoted below by concatenation, with the scalar on the right), 
is a semimodule (the analogue of a module) over Mmax- It is also endowed 
with the following operation \ which comes from the residuation of the map 
that multiplies a scalar by a given vector (see Section [2]): 

x\y := sup{A G Mmax \ xX<y} , (1.1) 

where the order < in ( |1.1[ ) is the usual partial order. 

The most natural "distance" [H [TJ [HI [16] on the space ^"^^x is the (ad- 
ditive analogue of) Hilbert's projective distance d, which can be defined 
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by 

d{x,y):=i{x\y)CS{y\x))-, (1.2) 

where the superscript — means taking the usual opposite, that is, 

A-:=-A VA g1:=RU{-oo,+oo}; (1.3) 

note that here d{x,y) G M. When the vectors x and y have only finite 
entries, 

d{x, y) = max (xj -yi + yj - xj) , 

«jG[n] 

where [n] := {1, . . . , n}. 

The same definition can be used on any residuated idempotent semimod- 
ule, and it generalizes there the usual Hilbert projective metric considered 
on cones of Banach spaces [6]: if u,v are two vectors in the interior of a 
closed convex pointed cone C in such a space, the Hilbert projective metric 
is classically defined by 

Hilb(u, v) = min log{^|A > 0,^ > 0, Xu<v<nu}, (1.4) 
A 

where u < v means that v—u G C. When M" is thought of as the image of the 
interior of the standard positive cone by the map which takes the logarithm 
entrywise, so that Xi = logUi and yi = logWj, we get d{x,y) = Hilb(M, w) 
(see ^ Section 3.3]). 

If one avoids vectors with only infinite entries, then d satisfies all the 
properties of a projective distance, except that it may take infinite values 
(see Section [2]). 

If y is a subset of MJ^^xi ^ ^ ^max' o^^^ defines as for a usual distance: 

d{x,V) := inf d{x,v), (1.5) 

and we define an element of best approximation, or a best approximation, of 
X in V, or a nearest point to x in V, as an element vq of V such that 

d{x,vo) = d{x,V). (1.6) 

In the present paper we shall study the best approximation for Hilbert 's 
projective metric in h-complete subsemimodules oiW^^-^. We recall that any 
semimodule V over Mjj^ax is an idempotent monoid for its additive law, and 
is thus "naturally" ordered by the relation < defined by 

x<y-^x(By = y, (1-7) 

which is such that the supremum coincides with the addition © of the semi- 
module. It is said to be h-complete if any subset of V bounded from above 
has a supremum in V and if the scalar multiplication distributes over all such 
infinite sums (see Litvinov, Maslov and Shpiz [17J). In particular, M^^^^ is a 
6-complete semimodule over Mjjiaxi and its natural order is the usual partial 
order. A subsemimodule V of M^^^^ is a h-complete subsemimodule of MJ^^^^ 
if the supremum of any subset of V bounded from above belongs to V. 



BEST APPROXIMATION IN MAX-PLUS SEMIMODULES 



3 



Let us also recall that for a 6-complete subsemimodule V of M.'^^^ the 
canonical projection operator Py of MJ^j^^ onto V is defined [8| by 

Pv{x) := max{v G V\v < x}, Vx G M^^^, (1.8) 

where max denotes a supremum which is attained (by some element of V). 
Then (see [SmSKTB]) for any x £ ^^g,^, Pv{x) is a best approximation of x 
in V (such a best approximation is not necessarily unique), that is, 

d{x,Pvix)) = d{x,V). (1.9) 

Some of our results are inspired by -and bear some analogy with- those 
known from the theory of best approximation in normed linear spaces by 
elements of linear subspaces (see e.g. |i21j). reformulated in terms of the 
"semi-scalar product" (see e.g. [IB]). These analogies have led us even to 
the discovery of some new properties of the canonical projections onto semi- 



modules (see e.g. Theorem |4.3| and Corollaries 4.2, 4.3, 4.5). 
The structure of the paper is as follows. 

In the preliminary Section [2] we give some notations, concepts and facts 
that will be used in the sequel, concerning residuation for scalars, vectors 
and matrices and its connections with the additions -|- and +' on M, and the 
Hilbert projective distance d and anti-distance 5 on a complete semimodule 
X, with special emphasis on the particular cases X = ^^^^^ and X = M^^^^. 

In Section [31 we introduce the support, upper support and lower support 
and the "part" of an element x £ l^max show that with the aid 

of these concepts one can reduce the study of best approximation of the 
elements x E I^max by the elements of a 6-complete subsemimodule V of 
^max to the case where x G M" and V C M" U {— oo}, where —oo denotes 
the vector of MJ^g^,^ with all its entries equal to — oo. 

In Section |4| using the known fact [HI |13] that for every 6-complete sub- 
semimodule V of MJJjjjx s-^d every outside point x there exists a "universal 
separating half-space" H = Hy^x, defined with the aid of Pv{x), satisfying 
V C Hy^x and x G M."'\Hy^x, we show that the problem of best approxi- 
mation of X by elements of a 6-complete subsemimodule V of MJJjg^j^^ can be 
reduced to the problem of best approximation of x by elements of a closed 
half-space H of MJJjg^^- To this end we prove the following properties of H: 
for each x G M"\y we have Py{x) = Ph{x) and d{x,V) = d{x,H). As in 
[S] , for more transparency we prove first corresponding results for "complete 
subsemimodules" of Muja^^ and separation by "complete half-spaces" of Mj^^xj 
from which we deduce the results on MJJ:^^^^- 

In Section [5[ we prove for a closed half-space H of M^j^^^ and an outside 
point X £ W^\H a formula for the distance d{x, H), and we obtain a formula 
for the canonical projection Ph{x) of x onto H. 

In Section [6| we show that every closed half-space of M^^^-,;^ admits a canon- 
ical representation with the aid of coefficients with disjoint supports, and 
we particularize this result to obtain the canonical form of the universal 
separating closed half-space of a 6-complete subsemimodule V of M^g^ from 
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a point X ^ V. The latter canonical form shows that when the canonical 
projection of x onto V is finite, the universal separating closed half-spaces 
always have "finite apex". 

In Section [7| using the results of Section [6j we give characterizations of 
the elements of best approximation by arbitrary half-spaces (not necessarily 
with finite apex) for an element x G Mmax- '^'^ ^^"^ section we also 

give geometric interpretations in simple particular cases. 

Finally, in Section [8| as an application of the main distance formula of 
Section [5j we obtain a new algorithm to solve systems of max-plus linear 
inequalities Ax > Bx, where A, B are p x n matrices. This algorithm uses 
the technique of cyclic projectors pH]; it may be thought of as a max-plus 
analogue of the Gauss-Seidel algorithm, and it is shown to be faster than 
the earlier alternated projection algorithm of [11], although it remains only 
pseudo-polynomial. 

Let us mention that the results onX = Mj^g^^^^ of this paper can be extended 
to more general assumptions on a complete semimodule X. To this end, one 
needs to extend the concept of "opposite" A~ of (1.3). A rather complete 
theory of an extension of the "opposite" is developed in but we shall not 
pursue here that level of generality. 



2. Notations and preliminaries 

2.1. Residuation. As mentioned above, we denote by Mmax the semiring 
composed of the set M U {— oo} endowed with the maximization operation 
as addition //©i/ := max(//, v), the usual addition as multiplication fi^u := 
fi+v (also for jj, = u = — oo), and the neutral elements — oo and for addition 
® and multiplication ® respectively. Furthermore, we shall denote by Mmax 
the so-called complete max-plus algebra, which is the semiring composed of 
the set M := M U {— oo, +00} endowed with the maximization operation as 
addition, that is, 

/i © 1/ := max(//, u), 

and with the extension to M of the usual addition + of M U {—00} as multi- 
plication ^®v = /U + i^, by the convention 

. , . / +00 ifaGMU{+oo} ,^ 

a + (+00) = (+00) + a = <^ . (2.1) 

[ —00 II a = —00. 

Throughout this paper we shall consider the space MJ^^x (respectively, 
^^max) of n-dimensional column vectors x = (xi, . . . , Xn)^ , where xi, . . . , x, 
belong to Mmax (respectively, Mmax) and the superscript --^ denotes the trans- 
position operation, endowed naturally with the pointwise addition (denoted 
by ©) and multiplication by a scalar, that we shall denote by a concatenation 
on the right. This is a semimodule over Mmax (respectively, Mmax)- We shall 
denote such column vectors, or equivalently, n x 1 matrices, by the letters 
X, y, z, u, h,. . . We shall also consider matrices over Mmax and Mmax, denoted 
by capital letters A,B,... and employ the usual concatenation notation for 



BEST APPROXIMATION IN MAX-PLUS SEMIMODULES 



5 



product of matrices, as well as for the multiplication of an element of MJ^g^^ 
(or Mjj^g^j^) by a scalar, that we shall put on the right (as if scalars were one 
dimensional square matrices). So if x = {xi, . . . ,Xn)'^ S I^max (c"^ ^^max)> 
and A G Mmax (respectively Mmax), then xX is the vector (xi + A, . . . , x„ + A)^ 
(the notation x + A is also used in the literature) . 

As in usual algebra, any max-plus linear operator (f) from MJJ^^^^ to M^^^^ 
(respectively M^^g^^^ to Mj^^^^), i.e., satisfying (j){x (B y) = 0(x) © (j){y) for all 
x,y^ K^iax (respectively M^^J and ^{xX) = 0(x)A for all x G R^^^ (1^^^) 
and A G Mmax (I^max) Can be represented by (and identified to) a m x n 
matrix A = (^ij)ie[m],je[n] over Mmax (respectively Mmax), with (p{x) = Ax, 
that is (j){x)i = maxjg[„](^,j + xj) for i £ [m] (see [4j). In particular, when 
171 = 1, the dual space (KJ^^^^)* (respectively (Kmax)*) of all max-plus linear 
forms over M^J^g^j^^ (respectively Kmax)' that is, of all max-plus linear functions 
(^max)* ~^ I^max (respectively (Kmax)* ~^ I^max) is isomorphic, and shall be 
identified, with the space of all n-dimensional row vectors, or equivalently, 
1 X n matrices, having their entries in Mmax (respectively, Mmax), which we 
shall denote by a = (oi, . . . , a„), b, . . . 

Spaces of scalars, vectors and matrices over Mmax (I^max) are idempotent 
monoids with respect to addition and their "natural order" for which the 
supremum operation is equivalent to the addition of the monoid, and that 
order coincides with the usual partial order. They are 6-complete (complete) 
semimodules over Mmax (I^max)) in the sense that will be recalled below. 
This allows one to define the residuation operation A\B for any matrices 

^GM^ax andSGM^axby 

A\B := max{C G Ij^a? I < B}, (2.2) 

where the max means that that the supremum is attained; in particular, for 
any scalars n,^ e 

:= max{A G Mmax | ^ A < u}. (2-3) 

Since semimodules of matrices with entries in Mjjiax are not complete but 
only 6-complete, the residuation A\B of matrices A G Kma^ and B G Mmax 
is not necessarily in Mma/; however one can replace the ma ximum in the 



definition (2.2) of A\B by the supremum in Mmax^, as in (1.1). 

Let us denote by Mmin the so-called complete min-plus algebra, which is by 
definition the semiring composed of the set M endowed with the minimization 
operation as addition /i ©' z^, that is, 

V := min(/i, v), 

and with the extension to M of the usual addition -|- of M U {-|-oo} as mul- 



tiplication ^ ®' V = fi +' u, defined by the convention opposite to (2.1), 
namely: 

/ / \ / \ I f +00 if a = -|-oo ,^ 

^ ' ^ ^ I — oo if a G M U |— cx)j. ^ ' 
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The neutral elements of Mmin are necessarily +00 and for addition ©' = min 
and multiplication (g)' = +' respectively. 

Remark 2.1. a) The above operations (g = + and ®' = +' are nothing 
else than the "lower addition" + and "upper addition" + on M respectively, 
introduced by Moreau (see e.g. [TO]) and used extensively in convex analysis. 
This remark permits to extend the well-known results about + and + on 

M to the lower and upper product ® and ® respectively, on any complete 

semifield S, using the known rules for these operations (see e.g. [2]). 

h) Here we consider mainly operations of Mmax, whereas those of Mmin 
are considered as dual ones, hence the notations + and +'. Such "dual" 
notations were already used in the literature, e.g. in [lOj. 

We recall the following well-known rules of computation with + and +' 
on 1: 

Lemma 2.1. i^|il9j. formulas (2.1) and (2.3)). For any A,^,z^ G M we have 

-{^+'u) = -fi+{-u), (2.5) 
(A+' fi)+'u = X+' (/i+' 1^). 



By (2.5), the semiring Mmin can also be defined eQuivalently as the image 



of Mmax by the "opposite" map M — )• M, x 1— )• x with x defined as in (1.3), 
which means that the opposite map is an isomorphism of complete semirings 

from Mmax to Mmin- 

For the basic rules of computation with residuation of scalars and their 
extensions to residuation of vectors and matrices see e.g. [4, 8]. 

Let us give now some new properties of the residuation of scalars that we 
shall use later. 

Proposition 2.1. For G Mmax; we have 

^1^ = 1^+' i-fi), (2.6) 



with +' of (2.4) 



Proof. By Definition (2.3), we have 



fj.\u := max{A G M^ax | /U fX" A < z^} 



that is, in usual notations (with the convention (2.1) for +), 

;u\z^ = max{A G M I /x + A < z^}. (2.7) 

But, by [TU], p. 119, Proposition 3(c), for any ij,,u,X G M we have the 
equivalence 

^ + A<z^4^A<zv+' (-//) , (2.8) 
whence, by (|2.7|) and (|2.8|), we obtain 



fi\iy = max{A G M | A < 1/ V (-^)} = u +' (-^) . □ 
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Remark 2.2. For a somewhat similar result see |12^ the remark made after 
Example 3.2]. 

Corollary 2.1. For ^i^v & I^max; we have 

gR-^ fx and u £R , (2.9) 
= +00 fi = —oo or u = +00 (or both). (2.10) 



Proof. This follows from Proposition 2.1 and the definition of +', since 
—/X = +00 if and only if /i = — c«. □ 

Remark 2.3. For /i, € Mmaxi we have v < +oo, so (2.10) shows that 

= +00 -^11 = — oo. 

Hence, for x,y £ R'^ax^ "^^ have the following equivalence 

^\y = X = — oo (that is, Xi = — oo, Vi G [n]). (2-11) 

Since /u\z^ is an element of M, we get by taking the complement aries of 
the equivalences (2.9) and (2.10): 

Corollary 2.2. We have 

= —oo {fx or V ^R) and /i > — oo, v < +oo 

(n = +00 and u < +oo) or {fj, > — oo and v = — oo) . 

By the above, we can summarize all possible values of ^\z^ in the following 
table: 







—oo 


real 


+00 


— oo 




+00 


+00 


+ 00 


real 




— oo 


real 


+ 00 


+00 




— oo 


— oo 


+ 00 



Remark 2.4. a) Definition (2.2 ) gives that for any vectors x = (xi, . . . , x„) , 
2/ = (yi, • • • , VnV e I^max) we have 

x\y = max{A G Mmax | a;A < y} (2-12) 
= max{A G Rmax \ Xi X < yi {i e [n])} 

— ^i^[n]Xi\yi 1 

where [n] = {1, . . . ,n} and A denotes the infimum operation. Hence, using 
also (l2?6l). 



x\y 



max{A G M I + A < y,; (i G [ra])} 
min(yj +' {-Xi)). 



(2.13) 



b) By ( |2.13[ ) and <^^, for any x G M; 
x\x = ^i(^[n\Xi\xi = min(xi +' (-Xj)) 



we have 

+00 if X G {— oo, +oo}' 
if X ^ {-oo, +oo}^ 



(2.14) 
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c) By (2.12) we have the following equivalence: 

X<x\y'^xX<y, (2.15) 

for all A € Mmax and x, y G I^max ^^"^ ^ I^max and x,y £ I^max- 

2.2. Hilbert projective distance. For a complete semimodule X over a 
complete idempotent semiring S and for any x,y £ X, let us set 

6{x,y) := {x\y)(^{y\x) , (2.16) 

where (8) denotes the multiplication of S. The last part of the following 
result of [8] shows that when S is commutative, the mapping 6 : X x X ^ S 
satisfies an inequality opposite to the triangular inequality for a distance, 
and thus S{x,y) may be called an "anti-distance"; by abuse of language, 
we shall also keep this term in the non-commutative case, even when S is 
not symmetrical. Recall that, since S is complete, the partial order relation 
defined by (1.7) determines an infimum operation, denoted by A, see |8j. In 
what follows, we denote by 1 the unit element of S. 

Proposition 2.2. [S^ Theorem 17] Let X be a complete semimodule over 
a complete idempotent commutative semiring S. Then, for any x,y,z E X, 
we have 

S{x,y) < {x\x)A{y\y), (2.17) 
6{x, y) = 1 =^ y = xX, for some A G S, (2-18) 
6{x,z) > 6{x,y)<E)6{y,z) . (2.19) 

Following jZl Ellis], we define the Hilbert projective distance d on M^ax 

by 

d{x,y) ■.= 6{x,y)~, (2.20) 
with 6 of (2.16), that is, by the same expr ession (1.2) as on MJJj^^-,;^, where 
the superscript — is defined on M by (1.3). For brevity, in the sequel by 
"distance" we shall always mean the Hilbert projective distance. 

Corollary 2.3. For x,y,z £ M^^^^ \ {~oo, +00}", we have 

dix,y) > 0, (2.21) 
d{x,y)=0 4^ X = yX, for some X £R , (2.22) 
d{x,z) < d{x,y) + d{y,z) . (2.23) 
More generally, for all x,y,z G M^ax' '"'^ have 

d{x,z) <d{x,y)+' d{y,z) , (2.24) 

and the implication 

d{x, y) = ^ X = yXJor some A G M . (2.25) 

(Recall that in the present setting, yX is now the vector with entries yi + X, 
for i G [n].) 

This result means that if one avoids vectors with only infinite entries, 
then d satisfies all properties of a projective distance, except that it may 



BEST APPROXIMATION IN MAX-PLUS SEMIMODULES 



9 



take infinite values. The term "projective" comes from (2.22). Tliis result 
was given without proof in [TJ p. 6]. For the sake of completeness, we give 
here a proof, using Proposition |2.2[ 



\ {— oo, +00}"", then by (2.14) we have x\x 

0, so d{x, y) 



Proof. ( |2.2lD : If x, y € M 

y\y = 0, and hence by (2.17) we obtain 6{x,y) < A 

Hx y)- > 0. 

( |2.25[ ), ( |2.22| : U x,y £ a nd d{x,y) = 0, then 6{x,y) = d{x,y)- = 

0~ = = 1, and hence by (2.18) there exists A G Mmax such that y = xX. 
Thus, we have the implication =^ in (2.25) and (2.22). Conversely, if y = xX, 
where x,y £ ^max \ {—00, +00}" and A G M , then x\y = x\{xX) = {x + 
X) — X = X and y\x = {xX)\x = x — {x + X) = —X = X^ , whence 

d{x, y) = d{x, xX) = ((x\(xA)) ((xA)\x))" = A" O A = 0. 

( |2.24D , ( |2.23D : Taking the opposite of ( |2.19| ) and using ([2^, we get 

d{x,z) = d{x,zy < {6{x,y) ^6{y,z))- 

= ^{y, zy ®' 5{x, yy = d{y, z) +' d{x, y), 

that is, ( |2.24[ ). F inally , if x,y,z G M^ax \ {-0 0, +00 }", then by (|2.2l[ ) all 
the quantities in (2.24) are nonnegative, hence (2.24) reduces to (2.23). | 



Remark 2.5. a) (2.21) does not hold for x = y £ {—00, +00}". Indeed, 
then x\x = +00 (by (2.14)), whence 5{x,x) = +00, so 

d{x,x) = 6{x,xy = —00, Vx G {— 00, +00}" . (2.26) 

(so 



Consequently, if y is a subsemimodule of 
we have 



r 

^max 



d{—oo,V) = inf d{—oo,v) 
which shows that the best approximation of x 



00 G V), then by ( |2.26[ ) 
(2.27) 



-00 



-00 by y is trivial. 

b) The implication <;= of (2.22) does not hold if x G {—00, +00}", since 
then the right hand side of (2.22) implies that x = y, but then by a) above, 
d{x, y) = —00, so that the left hand side of ( 2.22[) doe s not hold. 

c) In general one cannot replace +' by + in (2.24). Indeed, for example 
if X = y G {—00, +00}" and z G W\ then d{x,z) = +00 and d{x,y) = —00 
(by ( |2.26[ )), d{y, z) = +00, so d{x, z) ^ d{x, y) + d{y, z). 

d) In the sequel in the proofs of some statements about d we shall rather 
work with 5 instead of d in order to use only + instead of both +' and +, 
and then only in the final step of the proof we shall pass to the conclusion 
for d{x,y) = 6{x,yy. 

In [8] the results are presented in the case of complete subsemimodules of 
a complete semimodule. Here we shall consider mainly the projection onto, 
and the best approximation by elements, of a 6-complete subsemimodule 
of M^jj^, but as far as possible, we shall write the results also for complete 
subsemimodules of Mj^^^^^. Recall that a subsemimodule V of M^^g^^^ is called 
complete if the supremum (or infinite sum) of any subset of V belongs to V 
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and the scalar multiplication 



+ distributes over all infinite sums. If V 



is a subset (and in particular a subsemimodule) of M^jg^^) ^ G I^max' oi^^ 
simply defines the distance d(x, V) of x to F and the best approximation of 
X by an element vq of V as in the case of MJJjj^^, that is by (1.5) and (1.6). 
For a complete subsemimodule V of M^nax ) the canonical projection operator 
Py of Mj^g^x onto V is also defined [8] by (1.8) for all x G Kmax- 



2.3. An equivalent reformulation of the inequality Ax > Bx. For a 

later application of our main distance formula to the solution of the system 
of inequalities 

Ax > Bx, (2.28) 
where A, B : MJ^^^^ — )• Mmax are p x n matrices with entries in Mmax, we give 



here an equivalent reformulation of (2.28). We denote by Ai and Bi the 



ith rows of A and B, respectively. We recall that for B as above, which in 
addition satisfies the assumption 

for all j £ [n] there exists i G [p] such that Bij ^ — oo, (2.29) 

one defines (see e.g. [3j, [1] and the references therein) the residuated operator 
B* from Knax to W^^^ by 

{B*y)j=\ni{-Bij+' Vi). (2.30) 



We shall assume that the matrix B satisfies assumption (2.29). 



The term "residuated" refers to the well-known equivalence of the in- 
equalities 

Bx<y^x< B*y. (2.31) 
We recall the easy proof of this equivalence: We have 

< y ^ {Bx)i < yi, yi < i < p <^ sup{Bij + Xj) < yi, Ml < i < p 

j 

<^ Bij + Xj < yi, yi < i < p, yi < j < n 

< ~Bij +' yi, < i < p, < j < n 

^ Xj < mi{-Bij +' yi) = {B*y)j, yi < j < n ^ x < B*y. 



Bx 



Note that (2.30) is a particular case of residuation operators for matrices 



in the sense (2.2), since regarding y E 



as a p X 1 matrix we have 



B*y = B\y; 



indeed, using (2.31), we obtain 
B*y = max{x G 



< B*y} = max{x G R^^^\Bx < y\ = B\y. 



Applying (2.31) to y = Ax, we get 

Bx < Ax 4^ X < B*Ax. 



(2.32) 



Finally, since the right hand side of (2.32) can be written in the form of 

(2.33) 



the equality x = B'^Ax A x, we obtain the equivalence 

Bx < Ax <^ X = B*Ax A X 
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which we shah use later on. 



3. On the distance to a subsemimodule of 



Next we shah give some properties of the distance d of (1.2) and we shall 



show that one may reduce the study of the best approximation of elements 
X G by the elements of a 6-complete subsemimodule V of M^^^^ to the 

case where x G M" and F C M" U {— oo}. 



of: 



we define the 



Definition 3.1. For an element x = {xi, . . . ,Xn)^ ^^max' 
support Supp X, lower support Lsupp x and upper support Usupp x of x by: 



Supp x 
Lsupp X 
Usupp X 



{i G [n] I Xi G M}, 
{i G [n] I Xi < +oo}, 
{i G [n] I Xi > — oo}. 



We have trivially 



Moreover, when x G 



Supp X = Lsupp X n Usupp X. 
we have 
Lsupp X 



(3.1) 



'■max' 



n 



Lemma 3.1. For any x, y G ^^aax 

1°. x\y > — oo. 
2°. There exists A G 

i G [n]. 
3°. We have 



the following statements are equivalent: 
such that xX < y, that is, Xj + A < yi for all 



Usupp X C Usupp y, Lsupp x D Lsupp y. 



(3.2) 



Proof. ^ Let x, y G M^g^ be such that x\y > — oo. Then there exists 

A G M such that A < x\y and hence by (2.15), xA < y. 

^ =^ [sj'. Let x,y £ Kmax A G M be such that xA < y, that is, 
Xi + X < yi for all i G [n]. It follows that if Xj > — oo then y^ > — oo, 
which shows the inclusion Usupp x C Usupp y. Similarly, if yi < +oo then 
Xi < +00, which shows the inclusion Lsupp y C Lsupp x. 



Assume that x, y G Mj^^^ satisfy (3.2 ). Since x\y = miujgj^j Xi\yi, 



we get that x\y > — oo if and only Xi\yi > 
Vi 

Xi 



OO for all i G [n]. Now, if 
oo then i G [n] \ Usupp y so by (3.2), i G [n] \ Usupp x, that is 
oo, whence by (2.10), x,-\yi = +oo > — oo. Similarly, if Xj = +oo 
then i G [n] \Lsupp x so by (3.2), i G [n] \Lsupp y, that is yi = +oo, whence 
by (2.10), Xi\yi = +oo > — oo. Otherwise, yi > — oo and Xj < +oo, so there 



exist A and /u G M such that yi > X and Xj < /x, whence Xj\yj > /x\A G M. | 
As for convex sets without lines in linear spaces (see e.g. [5l[22]), we define 



the part of an element of ^ 



as follows: 
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Definition 3.2. The part [[x]] of x = (xi, . . . ,Xn)^ G I^max is the equiva- 
lence class of X for the equivalence relation (of comparability) 

X ~ y if there exist A, /i G M such that xX < y < xfi, 
that is, Xi + X < Ui < Xi + fi\/i £ [n]. 



Applying Lemma 3.1 symmetrically on x and y, we deduce 

■n 



max" 



Lemma 3.2. The following statements are equivalent for x, y G 

1°. d{x,y) < +00. 

2°. x,y are in the same part. 

3°. We have 

Usupp X = Usupp y, Lsupp x = Lsupp y. (3-3) 

4°. We have 

Supp X = Supp y, a-oo{x) = (J-oo{y) and a+oo{x) = cT+oo(y) , 
where for any x G M^ax and X = ibcxD we denote 
ax{x) := {i G [n] \ Xj = A}. 

Proof. ^ If d{x,y) < +oo, then (x\y) (g) (y\x) = 5{x,y) = d{x,y)~ > 

— oo, which implies that both x\y and y\x are > — c«, since — oo <8 M = 
^ (8) — oo = — oo for all /i G Mmax- Hence by the implication ^ of 



Lemma 3.1 , we get that there exist A, /u G M such that xX < y and yfi < x. 
Since G M is invertible, it follows that xX < y < x^~^, hence x and y are 
in the same part. 

^ =^ [3]'. Assume [2|', so there exist A,;U G M such that xX < y < x/i. 
By the implication [2]' of Lemma 3.1 we get the inclusions (3.2). But, 



since /i, A G M are invertible, we have yfj,-^ < X < yA"\ so thar|2|' also 
holds for the pair (y, x). Consequently, we get the opposite inclusions to 



( |3.2[ ), whence the equalities (3.3). 

^ =^[lh Assume now the equalities ( |3.3[ ). By the implication [sj' =^[lj' of 
Lemma [371] applied to the two pairs (x, y) and (y, x), we get that x\y > — oo 
and y\x > — oo. This implies that 5{x,y) = (x\y) iS" {y\x) > — oo, whence 
d{x,y) = S{x,yy < +oo. _ 

[s]' =^[4|'. This follows from the fact that for all x G M^^x have (3.1) 
and 

a-cx){x) = Lsupp X \ Usupp X, cj_|_oq(x) — Usupp X \ Lsupp X. 

Ilf ^ 1^" Similarly this follows from the fact that for all x G M^^x '^^ 
have 

Lsupp X = Supp X U a-ooix), Usupp x = Supp x U a+oo{x). | 



Remark 3.1. a) The equivalence [2|' 44>[T|' of Lemma 3.2 can be expressed 



in the form of the following useful formula for the part of x: 

M = {y G K.Mx, y) < +00} Vx G Ca, . (3.4) 
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Hence, in particular, for any subset V of M^g^,^ we have 

V n [[x]] = {v£ V\d{x, v) < +00} Vx e l^^ax • (3.5) 

b) Similarly, the equivalences [2]' -i^^ and [2]' <;4>|4['of Lemma 3.2 can be 
expressed as formulas for the part of x, namely: 

[W] = {y ^ I^maxl Usupp y = Usupp X, Lsupp y = Lsupp x}, 
[[x]] = {y £ MmaxI Supp y = Supp x, ax{y) = cr\{x) (A = ±00) }. 

Corollary 3.1. For each x G M^^^^ \ {—00, +00}" we have [[x\] C M^g^^ \ 

{—00, +00}" and d is a projective distance on [[x]]. 

Proof. Let x G M^^^ \ {~oo, +00}*^ and y G [[x]]. If y G {—00, +00}^, then 
Supp y = {i £ [n] \ yi £ M.} = 0, whence by y G [[x]] and the implication 
[2]' =^ |4|' of Lemma [33} we obtain Suppx = 0, so x G {— oo,+c«}", which 
contradicts our assumption. Therefore we must have y ^ {— oo,+c«}", 
which proves the first assertion of the corollary. Finally, the second assertion 
of the corollary holds by (3.4). | 

Corollary 3.2. For any x G {—00, +00}" the part of x is reduced to the 
singleton {x}, that is: 

[[x]] = {x} Vx G {-00, +00}" , (3.6) 

and hence, in particular, {—00} is a part o/M^^j^ orM'^^^. Also, on [[x]], d 
is identically equal to —00. 

Proof. For any x G {—00, +00}" we have Supp x = and all the entries of 
X are determined by c7_oo(a;): 



Xi 



—00 for i £ a- 
+00 for i ^ a- 



Then, the equivalence [2|' of Lemma |3.2| implies that y G [[x]] if and only 
if y = X, which shows that [[x]] = {x}. Hence in particular, [[—00]] = {—00}, 
so {—00} is a part of M^^j^ or M^^^,. Also, by (2.26), d is identically equal 
to —00 on [[x]], for any x G {—00, +00}"'. | 

The main application to best approximation is the following: 

Theorem 3.1. If V is a subset ofW^,^ (orW^J and x £ R^,^ (orWl^J, 
then d{x,V) < +00 if and only if V intersects the part [[x]] of x (i.e., 
V n [[x]] 7^ 0j, and in that case 

d{x,V) < d{x,v) = +00, yv£V\[[x]], (3.7) 

so any best approximation of x inV is necessarily in [[x]\, and 

d{x,V) = d{x,Vr\[[x]]). (3.8) 
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Proof. Assume that d{x,V) < +00. Then ini^^y d{x,v) < +00, so there 



exists V such that d{x,v) < +00. By (3.4), we must have v G [[x]], so 

vn[[x]] /0. 

Conversely, assume that V Ci [[x]] / 0, say v G V Ci [[x]]. Then by f G 



[[x]] and (3.4), we have d{x,v) < +00, so by f G ^ we obtain d{x,V) < 



d{x, v) < +00. This proves the equivalence d{x, V) < +00 4^ V D [[x]] ^ 



Moreover, by (3.4) we have d{x,v) = +00 when v ^ [[x]], which shows 
formula (3.7), whence also d{x,V \ [[x]]) = inf^gy\^[[^.]] u) = +00, and 
any best approximation of a; in y is necessarily in [[x]]. Since V is the 
disjoint union V = {V Ci [[x]]) U {V \ [[x]]), we obtain 

d{x, V) = min{d(x, V n [[x]]),d{x, V\[[x]])} = d{x, V n [[x]]). 



The first part of Theorem 3.1 can be also expressed in the following useful 
form: 

Corollary 3.3. For any subsemimodule V ofM.'^^^ we have 

{x G Wljdix, V) < +00} = {x G Caxl^ n [[x]] / 0}. 
In the sequel we shall give some results in MJ^^^-,^. 

Corollary 3.4 (in Mmax)- a) -^or x G ^'^s,y„ we have [[x]] C MJ^g^^ "'^'^ 

[[x]] = {y G I Supp y = Supp x} . (3.9) 

b) For X G Kmax; '"'^ have 

d{x,-oo) = { '^^ 'f^>-^ (3.10) 
ij X = —00. 




Proof, a) By the implication [2|' =^|3[' of Lemma 3.2 and the obvious equiv- 
alence 



X e I^max -^{xe M^ax> Lsupp X = [n]), (3.11) 
we get for any x G MJ^^x ^^^^ V ^ [[^]] implies Lsupp y = Lsupp x = [n], 
whence y G MJJ:jax! ^^'^^ ^x\\ C KJJj^x fo^" element x G I^max- Moreover, if 



X G KJ^ax) then Usupp x = Suppx and hence, by (3.11) and the equivalence 
^ ^ of Lemma [O we have y G [[x]] if and only if Suppy = Suppx. 



b) li X > — oo then Supp x 7^ 0, and since Supp (—00) = 0, x and —00 are 
in different parts. Hence, by ( |3.4[ ), d{x, —00) = +00. On the other hand, by 
( 2.26| ) we have d{—oo, —00) = —00. | 



Remark 3.2. a) In particular, M" is a part of M^J^^xi indeed, the points in 
M" are exactly those that have support equal to the set [n], and hence, by 



(3.9), all points in M" are in the same part as one of them, say 0. 

h) When x = (xi, . . . , x„)^, y = (yi, . . . , ynf G M^Jj^x \ {-00} have the 
same support / C [n], we have 

d(x, y) = max(xi — yi) — min(xj — yj). (3.12) 
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Indeed, \i k ^ I := Supp x = Supp y, then Xk = Vk = — oo, so Xk\yk = 
+00 (see ( |2.11| )), and hence 

x\y = nim{xi\yi) = mm{mm{xi\yi), mm {xk\yk)} 

ie[n] iel A:e[ra]\/ 

= mm{xi\yi) = min(yj - Xi), 

where the terms in the latter expression are ah finite. Similarly, y\x = 
minjg7(xj — yj)- Consequently, we obtain 



d{x,y) = {{x\y) {y\x)) 

= -{mm{yi - Xi) + mm{xj - yj)) 

= max(xi - yj) - min(xj - y,), 



that is, ( |3.12D . 

c) Combining Remark 3.1 and Corollary 3.4 1), it follows that in 
have the equivalence 

d{x,y) < +00 Suppy = Suppx. 
Note that this also follows from Lemma 3.2, equivalence [if ■ 



,we 



(3.13) 



Remark 3.3. When x,y £ \ {~^}> the Hilbert projective distance 

d{x, y) can be characterized by 



d{x, y) = inf{ Y | A € M, /x G 
A 



y\<x<yij] . 



(3.14) 



To show this, we shall assume that x and y have the same support (otherwise, 
the set in ( 3.14[ ) is empty, so its infimum, +00, trivially coincides with 
d{x, y) = +00). Then, the maximal A G M such that yA < x is minjg/(xj — 
yj). Similarly, the term maxjg/(xj — yi) coincides with the minimal /x G M 
such that X < y/x. Therefore, ( 3.14[ ) coincides with the expression of d{x,y) 
in (I3I2I). 



Using formula (1.9), we get as a corollary of Theorem 3.1 



Corollary 3.5. a) IfV is a h-complete subsemimodule ofW^^^, andd{x, V) < 
+00, then Pvix) £ V D [[x]]. 

b) Consequently, if V is a h-complete subsemimodule of MJ^^^^^, and V D 
[[x]] y^0, then Pv{x) G Fn [[x]]. 



Proof, a) We have Pv{x) G F by the definition (1.8) of Pv{x). Furthermore, 
by (1.9) and our assumption we have d(x,Py(x)) = d{x,V) < +00, and 
hence by (3.7) we obtain Pv{x) G [[x]]. 
b) This follows from (3.5) and part a). | 

Proposition 3.1. IfV is a (h-complete) subsemimodule ofW^^^, then the 
set 

:= (T/n [[x]])U{-oo} (3.15) 
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is the smallest (h-complete) subsemimodule o/M^^x containing ^n[[x]] and 
we have 

d{x,V) = d{x,V^''^). (3.16) 



Proof. Assume that V isa 6-complete subsemimodule of M^^^^ and x G M^^^^ 
Since any subsemimodule of M^^^ contains necessarily — oo, any subseml 
module of M^ax containing V D [[x]] n ecessa rily contains V^^^ = {V D [[x]]) U 



{— oo}. Moreover, since — oo G V, by (3.15) we have {V D [[x]]) C V^^^ C V, 



whence, by (3.8) and (3.10), we obtain (3.16). 

Now let us prove that y(^) is a 6-complete subsemimodule of M^Jiig^^. It 
is easy to see that [[x]] U {— oo} is a subsemimodule of MJ^i^g^^^, since for all 
y, z £ I^max ^ ^ I^max) wc have Supp (y © z) = Supp y U Supp z and 
Supp yX = Supp y if A / — oo and Supp yA = otherwise. Hence, since V 
is a subsemimodule of MJ^^^^^, so is also the set 

f(^) = {vn [[x]]) u{vn {-oo}) = vn {[[x]] u {-oo}). (3.17) 

Let us show that V^^^ is 6-complete. Let M be a subset of V^^^ bounded 
from above by an element of V^^\ Since V^^^ C V, then M is also a 
subset of V bounded from above by an element of V, and since V is b- 
complete, then M admits a supremum in V. Let us denote it by m and 
show that it belongs to V^^\ If m = — oo, then m S V^^^ and we are 
done. Otherwise, there exists y £ M \ {—00} C [[x]]. Since m > y, we 
get that Supp m D Supp y (by the implication ^ of Lemma 3.1) 



and since Supp y = Supp x for all y € [[x]] (by Corollary 3.4, a)), we 
obtain Supp m D Supp x. Conversely, if i ^ Supp x, then y, = —00 for all 
y G [[x]] U { — 00}, hence for all y G M C V^^^ C [[x]] U {—00}, which implies 
that rui = sup{yj | y G M} = —00. This shows that Supp m C Supp x, 
hence the eq ualit y, which is equivalent to the property that m G [[x]] (again 



by Corollary 3.4, a)). This implies that m G [[x]] H F C V^^\ and shows 
that is a 6-complete subsemimodule of M^J^g^^. | 

Now we shall show that one can reduce the study of the best approxima- 
tion of elements x G ^^a.^ by the elements of a 6-complete subsemimodule 
V of M^ax to the case where 

X G M''',^ C M"' U{-oo}, (3.18) 

with a suitable n' < n depending on x. To this end, for any / C [n] and 
X G M^^x! Ist us denote by x|/ the image of x by the restriction rj to 
coordinates in /: 

ri ■■ K^iax ^ ^max, X ^ x\l := (Xi)ie/ . (3.19) 

We shall also use the notation 

V\j := {v\i \ veV}. (3.20) 
Lemma 3.3. Let I C [n] and denote 

Mi := {y G K.^, \ Supp y Cl} . 
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a) r/ is injective on Mj. 

b) For all y,z £ Mj, we have 

d{y,z) = d{y\i,z\i), 

where in the right hand side d is the Hilbert projective distance on M^g^^. 

c) Ify€R^,,,,WcMj, then d{y,W) = d{y\j,W\i). 

Proof, a) Let y' , y" £ Mj be such that rj{y') = rj{y"), so Supp y', Supp y" C 
-^5 y'i = Hi ^ -^)- Then y'j = y'- = — oo for aU j ^ /, and hence y' = y" . 
Thus r/ is injective on Mj. 

b) The second assertion follows from the fact that for y,z €z Mj, A G Mmaxj 
yA < 2; if and only if y\jX < z\j. Indeed, we have 

d{y,z) = {{y\z) ^ {z\y))- 

= (sup{A G MmaxlyA < z} (g) SUp{;U G Rma.x\z^l < y})~ 

= (sup{A G Mmax|2/|/A < z\i} (g) SUp{/i G Mmaxk|//i < Vll})' 

= ^ = d{y\i, z\i). 

c) For the last assertion, let w G W. Since then w G Mj, from b) we get 
that d{y,w) = d{y\j,w\i), whence, since W\i = rj{W), we obtain 

d{y,W)= ml d{y,w)= inf d{y\i,w\i) = inf d{y\i,w') = d{y\j,W\i). 



Proposition 3.2. Let V be a h-complete subsemimodule ofW^^^ and x G 
^max such that d{x, V) < +00. Define 
J 



Isupp X G M^-PP := y(-)|supp X C RS-pp ^ U {-oolsupp x}, (3.21) 



where y(^) := n [[x]]) U {-00} fo/ |3.j4 )J. Then V is a h-complete 
subsemimodule of ^^i^ ^ = M^^pp ^' u {— oo|supp x}) a^' £ RmS?^, and we 
have 

d{x,V) = d{x'y) , (3.22) 

where in the right hand side d is the Hilbert projective distance on M^x^ ^ . 
Furthermore, an element v £ V is a best approximation of x in V if and 
only if Supp v = Supp x and v' := wlsupp x is a best approximation of x' in 

v. 



Proof. Clearly x' = x|supp x £ M^'^pp ^ and by Corollary 3.4 1) we have Supp 
V =Supp X for all v G [[x]], whence 

y = [(Fn[[x]])U{-oo}]|suppx. CM^'^PP"U{-oo|suppx}. 
Furth ermore, since V is a 5 -complete subsemimodule of Mmax; so is 



of (3.15) (by Proposition 3.1) and hence, since V = rsupp x(^^^^)) where 
''Supp X '■ I^max ~^ R-mix ^ is a max-linear mapping, V' is a 6-complete sub- 
semimodule of Mm^'j? ^. 
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By Proposition 3.1 , we have d{x, V) = d{x, and th e sup ports of the 



3.3 



we get that 

Supp X 
max 



elements of V^^'^ are aU included in Supp x, so by Lemma 
d{x, V) = d{x' , V), where d is the Hilbert projective distance on 

Assume now that v € V is a best approximation of x by V, that is, 
d{x , v) = d{x,V). Then by Theorem 3.1 
3.4 i), Supp V 

l^^lsuppx 



V G [[x]], whence by Corollary 
Supp x; also, v G V D [[x]] C V^^\ whence f|suppx £ 
V' . Therefore, using Lemma 



3.3 



we obtain 

d{x' , v\snpp x) = d{x,v) = d{x,V) = d{x,V'), 

so v' := w I Supp X is a best approximation of x' in V . 

Conversely, assume now that v G MJ^^^^ is such that Supp v = Supp x and 
f^lsupp X is a best approximation of x' in V', that is, d{x' , vlsupp x) = d{x' , V). 

rsnppxiv) (by the injectivity of rsuppx, see Lemma [33]), 



Then v|supp x 

whence v G V^^^ C V, and using Lemma 3.3 we obtain 



d{x,v) = d{x',v\supp x) = d{x',V') = d{x,V), 
so f is a best approximation of x in V. | 

Remark 3.4. Denoting by n' the cardinality of S upp x and using the iso- 



morphism between 



and M^^PP ^, Proposition 



3.2 



shows that one can 
reduce the study of the best approximation of elements x G ^"^^^ by the 
elements of a 6-complete subsemimodule V of MJ^^x to the case (3.18). Prac- 



tically, given V and x ^ V, whence also d{x, V), if we want to find a best 
approximation of x by V, one can pass to x' = x|supp x and V = l^^^^lsupp x, 
then find a best approximation v' of x' in V', and then, by the above, the 
element f = (f i, . . . , G F defined by 

v'^ if i G Supp X 
— oo if i ^ Supp X 



will be a best approximation of x by V. 



4. Further results on the universal separation theorem and 
applications to best approximation 

In classical linear analysis, one first reduces the problem of best approxi- 
mation of elements x by linear subspaces V to the case of suitable half-spaces 
H = Hy^x that separate V and x. In this section we shall apply a similar 
method to best approximation of x G MJ^^^,^ by elements of subsemimodules 
V of MJ^g^j^. The relevant notion of half-space used for separation depends 
on the framework in which we are working. When considering best ap- 
proximation by complete subsemimodules V of M^^^^^, it is natural to use 
separation by complete half-spaces of M^^g^^,, while for best approximation 
by 6-complete subsemimodules V of MJ^^^ it is natural to use separation by 
closed half-spaces of MJ^^^^^^, as we shall see below. 
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In [8], [9], |I3] and [Hj, the separation theorems for M^ax have been 
obtained as consequences of the results of [8] concerning complete semimod- 
ules. We shall follow here a similar approach, deducing the separation and 
best approximation results in ffi^^x from separation and best approximation 
results in complete semimodules, since the proofs are more transparent in 
the latter setting. 

Theorem 4.1. [51 Theorem 8] Let X be a complete semimodule over the 
complete idempotent semiring S. Let V be a complete subsemimodule of X, 
X ^ X and x , and consider the set 

K := {h £ X \ h\x < h\Pvix)} . (4.1) 

Then V C K andx ^ K. 

Remark 4.1. In [5], the result is written with the equality 

h\x = h\Pvix) (4.2) 



in (4.1); however, by a remark made in [14j for 6-complete semimodules, 
which is valid also for complete semimodules, since Pvix) < x, the inequal- 
ity h\Pv{x) < h\x holds for all h £ X, hence the two formulations are 
equivalent. 

In [n], a half-space of a complete semimodule X is defined as a set of the 
form 

K = Ku,v ■.= {h£X\ h\u < h\v} , (4.3) 

with u,v £ X. Note that all half-spaces K^^^ are complete subsemimodules 
of X. To be correct with the terminology "half-space", one should avoid the 
case where K = X, which holds if and only if n < v, and the case where 
K = {_L} where _L is the smallest element of X (which is also its neutral 



element for the addition ®). With this definition, the set K of Theorem 4.1 
is a (complete) half-space, and when x ^ V, K separates x from V. We 
shall call it the universal complete half-space of X separating x from V. 

Remark 4.2. In particular, if S = Mmax; the complete max-plus semiring, 
and X = Mj^ax' (complete) half-spaces can be put in a more usual form. 



namely every complete half-space K = Ku,v as in (4.3), with u,v £ I^max' 
can be written in the form 

Ha,b:={h£W^Jah>bh], (4.4) 

with a = (ai, . . . , a„), 6 = {hi, ... ,bn) £ I^Llx; where the notation ah means 

ah = max(oj -|- hi) , (4-5) 

ie[n] 



and conversely, every set II = Hafi as in (4.4) can be written in the form 



(|4.3|), with u,v £ M^^x- Indeed, by taking a = —u^,b = — f^, respectively 
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u = —b'^,v = —a^, and using (2.13), we have 

Ku,v = {h £ M^axl min(tii +' {-hi)) < mm{vi +' {-hi))} 

ie[n] 46 [n] 

= {h € niax(— lij + hi) > max(— + hi)} 

iG[n] je[n] 

= {h€ 1LJ(-u^)/i > {-v^)h} = H_^T^_,T. 

In [13] , the universal separation theorem is written with half-spaces of the 
form Hafi- Later we shall call a and b the "coefficients" of the representation 
( |01 ) of H. 

Since 

^,{h) := ah V/i G Cax, (4.6) 



where a G Mmax, is the general form of the max-linear forms on M.^^^ (e.g. 
by [8j, Theorem 36; see also ^7\), we can also write 



H = {heRl,Mh)>^,{h)}. 

Remark 4.3. Let us mention that identifying (Mj^^^^)* with M^g^^^ in the 
usual way, we may also regard ah of (4.5) as the "max-plus scalar product" 
of two row vectors or of two column vectors; however, we shall not use here 
this identification. 

Our next aim will be to show that for an element x of a complete semi- 
module (respectively of a 6-complete semimodule) X, the computation of 
the canonical projection onto, and the distance to, any (respectively any 
6-complete) subsemimodule V of X, can be reduced to the computation of 
the canonical projection onto, and the distance to, a complete half-space K 
(respectively a closed half-space H') of X. 

For a subset M of any complete semimodule X over a complete idempo- 
tent semiring S and any x G M let us set 

6{x,M) := sup 5{x,v); (4.7) 

then we may regard any vq £ M satisfying 

6{x,vo) >6{x,v), yvGM, (4.8) 

(or, equivalently, 6{x,vo) = 5{x,M)) as a "farthest point" in M from x, in 
the "anti-distance" 6. 

Remark 4.4. Since the Hilbert projective distance d on X is defined by 
(2.20), the relation (4.8) is equivalent to d{x,VQ)~ > d{x,v)~ {v £ M), that 
is, to d{x,vo) < d{x,v) {v G M), meaning that vq is a nearest point in 
M to x in the Hilbert 's projective metric d. This remark will permit us to 
deduce results on nearest points in Hilbert's projective metric d from results 
on farthest points in the anti-distance 5. 
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Theorem 4.2. ^ Theorem 18] If V is a complete suhsemimodule of a 
complete semimodule X over a complete idempotent semiring, and x G X, 
then 

6{x,Pvix)) > 5{x,v), yvGV , 
i.e., Pv{x) is a farthest point from x among the elements ofV in the anti- 
distance 6. I 

We recall that the Hilbert's projective distance d{x, V) between an ele- 
ment X and a set V is defined by (1.5). 

Corollary 4.1. IfV is a complete suhsemimodule of a complete semimodule 



X over a complete idempotent semiring, and ifxEX, then we have (1.9), 
or, in other words, 

d{x,Pv{x)) < d{x,v), yvev , 

i.e., Pv{x) is a best approximation of x inV for Hilbert's projective distance 
in X. I 



Remark 4.5. For X = Mj^^^^^, Corollary 4.1 has been given in p!3], Theorem 
1. 

We next establish some additional properties of the universal separating 
complete half-space and apply them to reduce the problem of best approxi- 
mation by subsemimodules to best approximation by half-spaces. 

Theorem 4.3. If V is a complete suhsemimodule of a complete semimod- 
ule X over a complete idempotent semiring S, if x ^ V , and if K is the 
associated complete half-space separating x and V (see Theorem 4-1), then 

Pv{x) = Pk{x). 

Proof. Since K D we have Pk[x) > Pv{x). li h ^ K \s such that h < x, 
we have 1 < h\x = h\Pv{x), where 1 is the neutral element of in S, and 
so, h < Pv{x). Since this holds for all h £ K such that h < x, it follows 
that Pk{x) < Pv{x). I 

Corollary 4.2. IfV is a complete suhsemimodule of a complete semimodule 
X over a complete idempotent semiring, if x £ X,x ^ V, and if K is the 
associated complete half-space (4-1) separating x and V, then we have 

d{x,V) = d{x,K) . 

Proof. Combining Corollary |4.1| and Theorem |4.3[ we obtain 

d{x, V) = d{x, Pv{x)) = d{x, Pk{x)) = d{x, K). | 

Finally, let us show the connection between the canonical projection and 
orthogonality. The relation (4.2) can be thought of as an analogue of the 
classical orthogonality relation {h,x — Pv{x)) = 0, where (., .) denotes the 
usual inner product, characterizing the nearest point Pv{x) of an element 
X onto a linear subspace. We next show that in the setting of semimod- 
ules, the canonical projection Pyix) is still characterized by the previous 
"orthogonality" property. 
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Definition 4.1. If X is a complete idempotent semimodule, for x,y,z€zX 
we shall say that the "bivector" (x, y) € X'^ is orthogonal to z, and we shall 
write (x, y)-\-z, if 

z\x = z\y. (4.9) 

The bivector (x, y) G X'^ is said to be orthogonal to a subset M of X, and 
we write (x, y)_LM, if (x, y)-\-z for all z G M. 

In particular^if X = M^^^ and x = (xi, . . . , Xn)'^ , y = (yi, • • • , ynV , z = 
(zi, . . . , Zn)'^ G I^max) then by (2.13), the relation (4.9) is equivalent to 

^i&[n]iXi +' i-Zi)) = \e[n]iyi +' i-Zi))- 



Theorem 4.1 shows that for any complete subsemimodule V of 'i^yaa.x 
any x ^ V, the bivector {x,Pv{x)) is orthogonal to V. Now we shall show 
that Pvix) is the only element of V with this property. 

Theorem 4.4. Let V be a complete subsemimodule of a complete semimod- 
ule X over a complete idempotent semiring, and let x £ X,x ^ V. Then, 
Pvix) is the unique element yofV such that {x,y)l.V, i.e., such that 

v\x = v\y, V-u G y . (4.10) 



Proof. By Theorem 4.1 y = Py(x) satisfies the above relations. We next 
show that y is unique. 

If y satisfies ( |4.10 ), then for all v € V we have y > v{v\y) = v{v\x), and 
so, y > Pvix) = sup^^yviv\x). 



Moreover, taking v = y in (4.10), we get y\x = y\y > 1, where 1 is 
the neutral element of S for and so x > y. Since Pvix) is the maximal 
element of V which is bounded above by x, it follows that y < Pvix). Hence 
y = Pvix). I 

Let us pass now to MJ^g^,^. As mentioned at the beginning of this section, 
when considering the 6-complete (but not complete) semimodule MJ^^^^^, in- 

— n 

stead of Mj^j^^^^, one is rather interested to take the closed half-spaces of MJ^g^^ 
as tools for separation, which are defined as the sets of the form 

F' = <, = {heR^,^\ah>bh} 

= {he M^ax I max(ai + hi) > max(6i + hi)} , (4.11) 

ie[n] ie[n] 

where a = (ai, . . . , a„), b = (6i, . . . , bn) G (Kmax)* ^o'^ vectors with 
coordinates in Mmax- We will call H' the universal closed half-space of MJ^^^ 
separating x from V. The term "closed" refers to the usual topology of 
M^iax) since the set H' of (4.11 ) with a, G (MJ^^^)* is always closed in MJ^ax 
(by |9], Proposition 3.7). A particular case which will be important in the 
sequel is that when H'^ has finite apex (we recall that the number — (a © 6) 
is called [15] the apex of H'^ ^). 

Any closed half-space H'^ ^ of MJ^^^ is the trace over MJ^^^ of a complete 
half-space of M^Jj^j^^ (but not vice versa). Indeed, taking X = M^^^x thought of 
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as a complete Mmax-semimodule, and taking u = —a^ and v = —6^, where 



a, 6 G (MJJjg^jj^)*, by Remark 4.2 we obtain 

Ku,v n Mjjjjjx = Ha^b n Mmax = -f^a,fe • 

For 6-complete subsemimodules of M.'^^^ we obtain the following results: 
Corollary 4.3. If V is a h-complete subsemimodule of MJ^^^^; '^^^ if x G 

d{x,Pv{x)) < d{x,v), \/v£V, 
i.e., Pv{x) is a best approximation of x inV for Hilbert's projective distance 



Proof. Since F is a 6-complete subsemimodule of MJ^^^, it has a completion 
V in Mjjja^^, which consists of the suprema of arbitrary subsets of V. The 
latter is a complete subsemimodule of Kj^g^^- It is readily seen that Pyix) = 



Pv{x), so the result follows from Corollary 4.1 



Corollary 4.4. IfV is a h-complete subsemimodule ofM"^^^, if x G W}^^^,x ^ 
V , and if 

H' = {heM.l^^^\h\x<h\Pv{x)] (4.12) 
= {h& MmaxI max(/ij - Xj) > max(/ij - Py(x)j)}, 

then 

Pv{x) = Ph'{x). 
Here, and in the sequel, for a, 6 E Mmax, we set 

a — b := a + (—6) . 



Proof. This follows similarly to Corollary |4.3[ using now Theorem 4.3 



Corollary 4.5. If V is a h-complete subsemimodule of MJ^^x^ '^^'^ if x G 
R^,^,x^V, then 

d{x,V) = d{x,H') , 



with H' of \4A^} . 

Proof. Applying Corollaries |4.3| and |4.4[ we get 

d{x,V) = d{x,Pv{x)) = d{x,PH'{x)) = d{x,H'). | 

5. The canonical projection onto, and the distance to, a 
closed half-space of mj^^x 

In the next result we shall give an explicit formula for the canonical pro- 
jection onto a closed half-space of MJJ:jax- To this end, the following notation 
will be useful: If 6 S (Mmax)* is a row vector and A G Mmax is a scalar, we 
set 

6\A : = sup{u € M;^ax \ bu < X} e Ca,, (5.1) 
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u being thought of as a column vector. So 6\A is a column vector with 
entries 



-P{n e Rl^^ I 6,n < A} = 6,\A = { ^^T't '.11T ' (5-2) 



(6\A)^. = isnp{u G m;^,,, I bu < A}), 

- h .\ \ — J 

+00 if j ^ Supp b. 

Theorem 5.1. Let a,b G (I^max)* row vectors and consider the closed 
half- space 

H = {he R^,^^ I ah > bh} . (5.3) 

Let L = Supp a, J = Supp b, and assume / n J = and that J / 
(6 7^ —00). T/ien for any x G MJ^^^^ we have 

Ph{x) = X a (6\ax) , (5.4) 

i.e., 

{PH{x))j = Xj A {bj\ax) 

_ jxj for j ^ J", 

~ [xjA {bj\ax)^ = Xj A (bj^ ( 0,^^ a^Xi)) for j £ J ^ ' ^ 

where J'^ denotes the complement of J in [n] . 
Proof. We set 

u := X A {b\ax) 

and first observe that the coordinates of u coincide with the right hand side 
of ([5^. 

Assume that h £ H is such that x > h. Then, ax > ah > bh, and so, 
h < sup{it' G R-max I bu' < ox} = b\ax. It follows that h < x A {b\ax) = u. 
This implies that Ph{x) = sup{/i G H\h < x} < n. To show that the 
equality holds, it remains to check that au > bu. We have 

bu = b{x A {b\ax)) < b{b\ax) = 6sup{u G Mj^^xl^^ ^ '^^1 < ax = ajX,. 



But by / n J = we have / C J'^, whence by ( |5.5[ ), ajXj = aiXi{bi\ax) = 
aiUi (i G /), and therefore ©j^j a^Xj = 0jg/ aiUj = a«. Thus, finally, 
bu < au. ■ 

The following result gives the main formula for the distance to a closed 
half-space: 

Theorem 5.2. Let a,b £ (^max)* '^^^ vectors, H the closed half-space 



(5.3), and x ^ H. Then 



A( u\ , j(ax) ^bx if ax ^-00 , 
a{x,H) = ax\bx = < (5.6) 
+00 i/ ax = —00. 
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Proof. Since Ph{x) maximizes the opposite of Hilbert's distance to x among 
the points of H, see Theorem |4.2[ we have 



5{x, H) = 5{x, Ph{x)) = {Ph{x)\x){x\Ph{x)) . (5.7) 

Assume first that Ph{x) ^ — oo. We claim that in that case we have 
Ph{x)\x = 0. Indeed, since Ph[x) < x, we must have A := Ph{x)\x > 0. 
Assume by contradiction that A > 0. Then since Ph{x) / — oo, Ph{x)X > 
PHix)0 = Ph{x). Since H is a max- plus linear subspace, and since Ph{x) G 
we have Ph{x)\ £ H, but since by the definition of A, Ph{x)X < x, this 
contradicts the definition of Ph{x) as the maximal element h £ H such that 
h < X. 



Then, using successively Equations (5.7), (5.4), and residuation properties 
of max-plus linear maps (see [HI), we get 

6{x,H) = {Ph{x)\x)(x\Ph{x)) = x\Ph{x) 

= x\(x A {b\ax)) = (x\x) A {x\{b\ax)) 

= (x\x) A {bx\ax) . (5.8) 

Since x ^ H, we have x ^ — oo (because — oo G {h £ ^"^^x I — — 
so x\x = 0. Also, again since x ^ H, we have bx > ax. Hence bx ^ — oo 



and bx\ax < 0, so (5.8) simplifies to 



6{x, H) = A {bx\ax) = bx\ax = (bx) ^ax 



Consequently, by (2.20), we arrive at 

d{x,H) = {S{x,H))-^ = ax\bx . 
Assume now that Ph{x) = —oo. Then since x ^ H , so x ^ —oo, we have, 



using (1.9), that d{x,H) = d{x,PH{x)) = d{x,—oo) = +oo. Moreover, 
by (5.5), we get that Xj = PH{x)i = — oo for all i J, so that in particular 
ttiXi = — oo {i ^ J). Hence by the definition of J and since bx > ax, we get 
that ax\bx = sup{A € MmaxlAox < bx} = +oo = d{x, H). | 



6. The canonical forms of closed half-spaces of Wl 



max 



We have the following result, which shows that every closed half-space 



(4.11) of MJ^j^j^ admits a canonical representation with the aid of coefficients 



with disjoint supports: 

Proposition 6.1. Let a,b £ {W^^^)*\{—oo} be row vectors such that a^b 
and there exists i G [n] such that ai>bi, and consider the closed half space 

H = {h£ M^^axl"^ > bh} (6.1) 

(the assumptions on the coefficients a and b are equivalent to {— oo} ^ H ^ 
^max)- ^' ^''^^ b' G (M^g^j,)* be the truncations of a and b defined by 



a', = r ^-^"^-^^ b', = n (6.2) 
I — oo if Oi < bi, I — oo ifaj>bj. 
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Then Supp a'Ci Supp b' = 0, and H can he written in the form: 

H = {he R"^^^ I ah > b'h] . (6.3) 

Proof. Let us denote 

J := {j G [n] I Oj < hj}, J" := {j G [n]\aj > bj}, 



so that 



ai for i G ^,^1 6j for j £j ^^^^^ 

— oo otherwise, | — oo otherwise. 



Thus, Supp (a') C and Supp {b') C J, whence Supp (a') n Supp (6') 



Furthermore, let H' be the right hand side of (6.3), and let us show that 
H = H' . The elements a' and b' satisfy a' < a and b' < b and since 
o-'i = CLi > bi for i G J'^, and 6^ = bi for i G J, we deduce that 6 < a' © 6'. 

Let /i G H', then < a'h. Hence 6/i < (a' ® 5')/i < a'/i < ah, so h £ H, 
which shows the inclusion H' C H. 

Conversely, let h £ H, then bh < ah. Since b' < b, this implies that 
b'h < ah. Let a" be the truncation of a to J, then a = a' ® a" and thus 

b'h < a'h © a"/i . (6.5) 



If the support of h does not intersect J, then a"h = — oo and (6.5) implies 



that b'h < a'h, that is /i G Otherwise, since < 6j for all i G J, we 



deduce that a"h < b'h, hence by (6.5), it follows that the maximum of a'h 



and a"h which is greater or equal to a'h, is necessarily equal to a'h. Hence 
again b'h < a'h, and thus h G H' . We have shown the converse inclusion 
H (1 H' , hence the equality. | 



Corollary 6.1. Let a,b and H be as in Proposition \6A\ and assume that 
X ^ H. Then, 

d{x, H) = a'x\bx , 
where a' is defined as in Proposition\6. l\ 



Proof. Using Theorem |5.2| for the coefficients a' , b' defined in Proposition 6.1 
we get that d{x, H) = a'x\b'x. Since x ^ H, we have ax < bx. Let J and b' 
be defined as in Proposition |6.1[ Since bi < ai when i £ J'^, we deduce that 
bx = b'x, which shows the corollary. | 



Definition 6.1. We shall call (6.3) the canonical form of the closed half- 
space H. 

For the computation of distances to, and elements of best approximation 
by, subsemimodules, it is worthwhile to write explicitly the canonical form 



of the universal separating closed half-space (4.12) for a pair {V,x), where 



V is a 6-complete subsemimodule of R^^.^ and x ^ V : 



BEST APPROXIMATION IN MAX-PLUS SEMIMODULES 



27 



Corollary 6.2. If V is a h-complete subsemimodule of 



and X £ 



^maxi^ ^ y is such that all coordinates of Pv{x) (and hence also of x) 
are > — oo, then the following closed half-space separates x from V : 



Hi 



V,x 



pn 

^max 



max {hj — Xj) > max {hj — (Py(x)j))} 

j\xj=Pv(x)j j\xj>Pv{x)j 



{h G 

= {he MSiaxI AjeJ hj\xj < Aj^jchj\Pv{x)j}, 

where 

J = {j e [n] I Xj = Pv{x)j}, r = {j G [n]\xj > Py(x)j}. 
Proof. This follows from Proposition |6.1[ setting 



(6.6) 
(6.7) 



-X 



-Pv(x) 



(j e N)- 



Indeed, then aj > hj 44> —Xj > Pv{x)j 44> Xj = Py{x)j (where the last 
equivalence holds by Pv{x) < x) and aj < hj 44> —Xj < —Pv{x)j Xj > 
Pv{x)j, whence by (6.2), 



-Xj ifxj = Pv{x)j 
-oo if Xj > Pv{x)j, 



-Pv{x)j if Xj > Pv{x) 



-oo 



if Xj = Pv{x)j. 



Consequently a'h = maXj\^.=p^(^^).{hj-Xj) andb'h = max^i^. ,>p^(^) , (/i^- 
Pv{x)j}, whence by (6.3) we obtain 

{h £ Ki^^la'h > h'h] 
{h G Kmax I ., max ^ {hj 



H 



max 

j\xj=Pv{x)j 



Xj) > max {hj — {Pv{x)j))} 

j\xj>Pv{x)j 



Hi 



V,x- 



Remark 6.1. In the above, since x ^ we have J'^ ^ 0. Furthermore, 
we also have J / 0, since otherwise Pv{x)j < Xj {j £ [n]), whence by (6.6) 
we would obtain Hy^ = 0. 

Note also that the coefficients —Xj and —Pv{x)j in the canonical form 
(6.6) of Hi^^ depend on V and x, while the coefficients a'j, h'- in the canonical 
form (6.3) of (6.1) don't. 

h) The assumption alone that all coordinates of x are > — c« does not 
imply that each element v oiV has all coordinates > — oo, as shown e.g. by 
the subsemimodule V = {(— 00,^2)1^2 £ 1^} of M^^^- 

c) Corollary 6.2 is a more precise form of [l3j, Theorem 3. 



By (6.7), (6.8) and the assumption that all Pv{x)j are > —00, we have 
Supp {a') = J and Supp {b') = J^, and hence in the situation of Corollary 



6.2 we always have 



Supp (a') U Supp I 



JUJ^ = [n]. 



(6.9) 



Definition 6.2. We shall call the sets H' of the form (6.3) satisfying 
Supp a' n Supp 6' = and (6.9), half-spaces with finite apex. 
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Note that the sets of this form are exactly the "tropical half-spaces" 



studied in [15], where the apex of the half-space (6.3) is defined as the 
vector -(a' 6')- 

Remark 6.2. In classical linear analysis, one first reduces the problem 
of best approximation of elements x by linear subspaces V to the case of 
suitable separating support half-spaces H = Hy^x by showing for them the 
equality of distances d{x, V) = d{x, H) and the equality of elements of best 
approximation in V and then one solves the problems of best approxima- 
tion for general half-spaces H, and this gives solutions also for the problems 
of best approximation by the linear subspaces V . In the case of best ap- 
proximation of X by elements of subsemimodules V of MJJ^j^^ such that all 
coordinates of Pv{x) (and hence also of x) are > — cxd, in order to apply such 
a method one needs to use closed half-spaces with finite apex, as shown by 



Corollary 6.2 



The following immediate consequence of Corollary 6.2 shows that the 
sectors of H' , as defined in [I5j are readily obtained from the previous 
representation, and that the apex of H' is precisely Py{x). 



Corollary 6.3. Let x,V and H' be as in Corollary 6.2. Then, the apex of 



the half-space H' is Pv{x), and H' is the union of the sectors 

H[ := {x G MS,,, I - iPvix))^ > . max (/i, - (Py(x)),)} Vz G / 

je[n]\{i} 



In the above the term "closed half-space" was introduced because of the 
analogy with the classical closed half-spaces {x £ M"|<I>(x) < c} of M", 
where ^> G (M")*, c G M. However, note that there is an important difference 
between the two cases. Namely, in the classical case of M", given a linear 
subspace V of M" and a point x ^ V, there exists a separating closed half- 
space H = Hv,x of M" (i.e. such that V Q H,x ^ H), with the additional 
property d{x,V) = d{x,H), but for any other separating closed half-space 
H' ^ H {V C H',x ^ H') we must have H' C H (strictly) and hence 
d{x,H') < d{x,H), because bd H' must be parallel to bd H (these facts 
are well known and easy to prove). However, this fact is no longer true in 
the case of closed half-paces H = V, H' and outside points x ^ H' in M^, 



^max) 



as shown by Example 6.1 below, in which H' D H, H' ^ H, d{x,H') = 
d{x,H): 

Example 6.1. Let 

H = V:={v€Ri,,\v2>vi} 

= {v e M^axl (-oo)ui e 0v2 e {-oo)vs > Ovi e {-oo)v2 e (-00)^3}, 
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Then F is a subsemimodule (actually a half-space, but not with finite apex), 
and 

Pv{x) = max{i; G F|(t;i,T;2,t;3)^ < (2,1,0)^} = (1,1,0)^, 

J = {j\x,=Pv{xW = {2,3},r = {j\x,>Pv{x),} = {l}, 

so J U = [3] , and hence the universal separating closed half-space H' of 



(6.6) has finite apex; in fact, 

H' = Hy.j. = {h eM.^^Jmax{-X2 + h2,-X3 + hs) > -Pv{x)i + hi} 

= {h\ max(-l + /i2, + /is) > -1 + hi} = {h\ max(/i2, hs + 1) > hi}. 

Furthermore, we have d{x,V) = d{x,H') and H C H' (strictly). This is 
illustrated in Figure [l| in which every max-plus line through the origin (i.e. 
the set of multiples of a vector of Mj^g^^) is represented by its intersection 
point with a hyperplane orthogonal to the main diagonal. 




Figure 1. The half-space H = {h e M^^^^ | /i2 > hi} (hght 
gray). The universal separating closed half-space H' with 



apex Ph{x) (dark gray), see Example 6.1 



7. The elements of best approximation by closed half-spaces 

By the above results, the problem of best approximation by subsemi- 
modules of M^J^g^^ can be reduced to that of best approximation by closed 
half-spaces with finite apex. In the present section, more generally, we 
give characterizations of the elements of best approximation by arbitrary 
closed half-spaces in M^^^ (that are not assumed to have finite apex). If 
a G (Kmax)* is a row vector and x G MJJ^^j^ a column vector, we define 

Argmax(a, x) := {i E [n] \ aiXi = ax} , (7.1) 
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which is always a nonempty set. The following is clear: 

ax / — oo =^ Argmax(a, x) C Supp a n Supp x . (7.2) 

The next theorem gives an analytic characterization of the set of elements 
of best approximation. 

Theorem 7.1. Let a,b £ (I^max)* '^^^ vectors, H the closed half-space 



(5.3), and assume that the sets 

I := Supp a, J := Supp h, (7.3) 

satisfy Ir\J = 9 and J {h ^ — oo). Furthermore, let x G Mmax; x ^ H be 
such that d{x, H) < +oo. For an element h G MJ^j^^^^ the following assertions 
are equivalent : 

1°. h is a best approximation of x in the closed half-space H; 
2°. ah >bh ^ — oo and 

x{bx)-^{ah) <h<xiax)-^{bh); (7.4) 

3°. There exist A ^ —oo and i G Argmax(o, x) such that the following 
conditions hold: 

Oihi = A , (7.5) 

bjhj = A , Vj G Argmax(6, x) , (7-6) 

Xkibxy^X < hk< (P//(x)) Jax)-U, (7.7) 

yk G [n] \ (Argmax(5, x) U {i}) ; 

moreover, in this case A is unique, namely X = ah = bh. 



Proof. By Theorem 5.2 and our assumption, d{x,H) = ax\bx < +oo, and 
so ax 7^ — oo. Furthermore, since x ^ H, we have bx > ax, and in particular 
bx 7^ — oo. 

[TJ' =^ Let h he a best approximation of x in H, that is, h £ H 
(so ah > bh) and d{x,h) = d{x,H), which is equivalent to the condition 
5{x,h) > 6{x,H), that is, 

{x\h){h\x) > ax{bx)-^ . (7.8) 

Since d{x,h) = d{x,H) < +oo, x and h must have the same support (by 
Lemma [33] ). Then, since ax / — oo we deduce that ah ^ — oo (indeed, there 
is at least one index i such that Qi'iX'i — (XX 7^ — oo, and so Xi ^ — oo; hence, 
since x and h have the same support, hi ^ — oo, and so ah > Oihi ^ — oo). 



Similarly, we deduce from bx ^ — oo, that bh ^ — oo. Fu rtherm ore, (7.8) 



implies that x\h > {h\x) ^{ax){bx) ^ or equivalently (see (2.15)) 

h>xih\x)-^{ax){bx)~^ . (7.9) 



Similarly, from (7.8) one also obtains 

x{x\h){ax)'^{bx) > h . (7.10) 

Since hX < x implies ahX < ax, it follows that h\x < sup{A|a/iA < ax} = 
{ah)\{ax) = {ah)~^{ax), whence {h\x)^^ > {ax)^^ah. Using this inequality 
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in (7.9), we get h > x{ah){hx) ^, which is the first inequaht y in (7.4). 



Furthermore, x\h < {bx)\{bh) = [bx)^^{bh) and together with ( 7.10 ), this 
implies that h < x(bh){ax)~^ , which is the second inequality in (7.4). This 
completes the proof of the implication [T]' ^=^[2]'. 

[2f ^[If- Let h be as in[2f. Then by ah > bh we have h £ H. Using 
(2.15), from the first inequality in ( |7.4[ ) we obtain that x\h > {bx)^^{ah). 
By the second inequality in (7.4), and the fact that bh ^ — oo, we obtain 



that h{bh)^^{ax) < x, which implies, using (2.15), that h\x > (bh)~^{ax). 
Hence {h\x){x\h) > {bx)~^{ah){bh) ~^{a x) and since ah > bh, we obtain 
{h\x){x\h) > {bx)~^{ax), that is, (7.8), which itself is equivalent to the 
condition d{x,h) = d{x,H). 

^ . Let be as in[2|', set A = bh, and pick some i G Argmax(a, h) 

(the latter set is necessarily nonempty). We shall see later that 



Argmax(a, h) C Argmax(a, x) 



(7.11) 



so that i G Argmax(a, x) as requested injs]'. 

By[2j', we must have A = 6/i G M. Multiplying the first inequality of (7.4) 



by b, or the second one by a, we deduce that ah < bh, and since ah > bh 
also holds by[2|', we get that ah = bh = A. Consequently, since by our choice 
i G Argmax(a, h), we have aj/ij = A. 

Using the fact that ah = bh = A, we deduce from (7.4) that 



Xk[bx 



) ^ X < hk < Xk{ax) ^A, 



yk £ [n] . (7.12) 

Furthermore, since 6^/1^ < bh = X, we deduce /i^ < 6fe\A = {bk\{ax)){ax)^^ X, 
for all G [n]. This, together with the second inequality in ( 7.12[ ) and for- 
mula (5.4) for Ph{x), implies 

hk < {xk /\bk\{ax)){axy^X= {Ph{x)) f^{axy^X . 

Together with the first inequality in (|7.7l), this establishes the inequali- 



ties (7.7) for all k G [n], and a fortiori for all fc G [n] \ (Argmax(6, x) U {%})■ 
Now we show ( 7.11| ). By the second part of (7.4) we have Ofc/ifc < 
akXk{ax)~^ X for all k G [n], and hence for any k such that a^Xk < ax, 
we have Ofc/ifc < af:Xk{ax)~^ X < A = ah, whence k ^ Argmax(a, /i), which 
shows (7.11). Since we already proved that aj/ij = A, we deduce ( |7.5[ ). 

Finally, if j G Argmax(6, x), that is, bjxj = bx, then A = bx{bx)~^X = 
bjXj{bx)~^X < bjhj < bh = X (where the penultimate inequality is obtained 
by multiplying by bj the first inequality of (7.7) for /c = j), whence we obtain 



(M) 



»[2f . Let h, i and A be as inJSK 
We claim that the inequalities in (7.7) are valid for all /c G [n]. 
Indeed, since i G Argmax(a, x), then by ajXj = ax < bx we have 



=)-iA 



aiXi{bx) ^X < bx{bx) ^X = X = aihi = aiXi{ax) 

Moreover, since Oj/ij = A G M, we have Oj 7^ —00, and so Xj {bx)-^X <hi< 
Xi{ax)~^X. Since i G / C J'^ by assumption, hence bi\{ax) = +00 (see 
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(5.2)), and so, 



hi < (xi A bi\{ax)){axy^X = (Pff (x)) .(ax)~U 



We deduce that (7.7) is valid for /c = i. 

Similarly, if G Argmax(6, x), then by b^x^ = bx and ax < bx, we have 
bkXk{bx)~^X = A < bkXk{ax)~^ X, where by (7.6) we have A = b^h^ € 
whence bk ^ 



X < bkXk{ax) 
-oo. Consequently, 



Xk{bx) ^X <hk < Xk{ax) ^X . 

Moreover, by (7.6), and the fact that bk 7^ — cxd, we get that 
all k G Argmax(6, x), hence, 

hk = {bk\{ax)){ax)~^ X . 

This, together with the second inequality in ( |7.13[ ), shows that 

hk = {xk A {bk\{ax))){axy^X = (P^ (x))^(ax)"U 



(7.13) 
bk\X for 



and so, (7.7) is valid for these k, which proves the claim. 

Multiplying the second inequality in (7.7) by a^, and using Ph{x) < x , 
we obtain that akhk < akXk{ax)~^ X < X for all k S [n], and using (7.5), 
we get that ah = X. Similarly, multiplying the second inequality in (7.7) 
by bk, and using again Ph{x) < x, we obt ain that bkhk < bkXk{ax)'^ X < 
bx{ax)~^X < A for all A: E [n], and using (7.6), we get that bh = X = ah. 
This equality, together with (7.7), which is valid for all k £ [n 



imply [2f. 



Remark 7.1. We observed in the proof of Theorem 



7.1 that if h is an 



element of best approximation of x, the inequality (7.7|) actually holds for 
all k £ [n]. It follows that 

PH{x){bx)-^X < x{bx)-^X <h< PH{x){ax)-^X. 

By comparing h with the extreme terms in the above inequalities, and using 
the characterization (3.14) of Hilbert's projective distance, we deduce that 

d{h,PH{x)) < {ax)-^{bx) = d{x,H) 

so that h lies in the intersection of two balls of radius d{x, H) in Hilbert's 
projective metric, one being centered at the point x, the other being centered 
at the point Ph{x). 

Remark 7.2. One can give a geometric interpretation of the conditions of 
Theorem 7.1 in terms of faces of the ball with center x and radius d{x, H). 
Indeed, let us fix some index i G Argmax(a, x), and let Fi denote the set of 
vectors h satisfying the conditions (7.5), (7.6), (7.7) of Theorem |7.1[ Then 
the conditions that aj/ij = bjhj for all j G Argmax(6, x), together with 
ax = aiX and bx = bjX, lead to hikj^ = bja~^ = Xixj^ {bx){ax)~^ . This can 
be rewritten with the usual linear algebraic notation, as 



hj — hi 



+ d{x, H), \/j G Argmax(6, x). 

Thus, if p is the cardinality of Argmax(6, x), we see that h satisfies p of the 
inequalities defining the facets of the ball of radius d(x, H) in Hilbert metric, 
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centered at the point x (the ball in Hilbert metric is a polyhedron in the 
usual sense, and so the standard notions of faces and facets -maximal faces-, 
see [53], apply to it). Therefore, the set Fi consisting of these vectors h lies 



in a n — p dimensional face of this ball, and Theorem 7.1 gives a disjunctive 



representation of the set of elements of best approximation, as the union of 



the sets Fi with i G Argmax(z,x). Note that the inequalities (7.7) indicate 
that Fi may be a strict subset of a face of the latter ball, as illustrated in 
Figure [3] below (right). 

Let us give some geometric interpretations of best approximation by 
closed half-spaces in simple particular cases. 

Example 7.1. Let n = 3, and 

H ■.= {he I ^2 > hi} = {he M^^^|a/i > bh}, 

where a = (— c«, 0, — 00), 6 = (0, — 00,— c«), and let xi > X2 > X3. Then, 
with the notations of the proof of Theorem |7.1[ we have Argmax(a, x) = I = 
{2} and Argmax(6, x) = J = {1}, so necessarily i = 2 and h = {hi, /12, h^)^ 
is an element of best approximation of x in if and only if there exists 
A G M such that 

h2 = hi = X, X3 - xi + A < /13 < X3 - X2 + A. 

The half-space H was already represented in Fig ure [l} Assume now that 



X = (2,1,0) , so that, as noted in Example 6.1 Ph{x) = (1,1,0) . By 



Remark |7.2[ the set of elements of best approximation is the set F2 , which 
lies in a two dimensional face of a ball in Hilbert's metric. This set is 
represented by a bold segment in Figure [2] 

Example 7.2. Consider now 

H = {he Rl,^, I max(/ii, h^) > /is} 

and X = (0,1,0)^. Here, a = (0, — oo,0) and b = (— oo,0, — 00). We have 
Ph{x) = (0,0,0)^, d{x,PH{x)) = 1, and 

Argmax(a,x) = {1,3}, Argmax(6, x) = {2} . 



Theorem 7.1 shows that the set of elements of best approximation of x is 



the union of the sets Fi and F^, defined in Remark 7^2 Condition [Sf of 



Theorem 7.1 yields 

Fi = {hGR^ \hi = h2, -1 + hi < hs < hi} . 

By symmetry, F^ is obtained from Fi by exchanging the variables hi and 
/13. This is illustrated in Figure [S] (left). 

Example 7.3. Let 

H := {x G Mj^ax I /i3 > max(/ii, /12)} . 
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Figure 2. Illustration of Theorem 7.1 (see Example 7.1). 
The half-space H = {h £ I^max I ^2 > ^i} (light gray); 
the maximal open ball in Hilbert's metric centered at point 
X = (2, 1,0)"^ and contained in the complement of H (dark 
gray): the projection Ph{x) is visible at its boundary. The 
set of elements of best approximation of x is the bold seg- 
ment. 




Figure 3. Left. A set of elements of best approximation 
of a disjunctive nature (Example 7.2). Right. The set of 
elements of best approximation may be a strict subset of a 
face of a Hilbert ball (Remark 7.2 and Example 7.3). 
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and X = (1,2,0)"^. It can be checked that Ph{x) = (0,0,0)"^, and that the 
set of elements of best approximation of x is a strict subset of a face of the 
ball of radius d{x,Pj{{x)) = 2, centered at x, see Figure [S] 

8. The cyclic projection algorithm to solve max-plus linear 

SYSTEMS 

The max-plus analogue, studied in [14], of the classical cyclic projection 
technique allows one to compute the canonical projection of a vector u G 
^max onto a subsemimodule 

V ■=Vir\---r\Vp (8.1) 

defined as the intersection of p closed subsemimodules by successively pro- 
jecting onto Vi,V2, . . . , Vp, Vi, . . .. The application of this idea to the case 
of intersection of half-spaces, thanks to Theorem 5.1, will lead us to a new 
algorithm to solve the system of inequalities 

Ax > Bx (8.2) 

where A, B are p x n matrices with entries in Mmax- 

Let us first explain how the method of [14] leads to a general algorithm. 
Formally, starting from an arbitrary finite vector = u, we compute the 
sequence 

e'+'=^W.o..)(e') Vfc>0, (8.3) 
where (/ mod p) denotes the unique number belonging to the set \p] = 
{1, . . . ,p} congruent to / modulo p and Py,. denotes the canonical projection 
onto Vj. 

Theorem 8.1. The sequence generated by the cyclic projection algorithm 
is non-increasing and converges to Py(n). 



Proof. Since Pv^{x) < x holds for all x and for all k, we have 

^(k + l mod p) ' 



so the sequence is non-increasing. We prove by induction that 

> Pv{u), Vfc > 0. 

For A; = 0, this follows from u > Pv{u). Assume now that > Pv{u). 
Since V C V(^f._^i modp) since Pv{-) is a monotone idempotent function, 
we have 

= ^'W^od.)!^') > Pvie) > PviPviu)) = Pv{u), 

which concludes the proof by induction. Hence, the non-increasing sequence 
must have a limit, such that 

^ > ^oo > Py{u). 

Consequently, again since Pv{-) is a monotone idempotent function, 
Pv{u) > PviD > PviPviu)) = Pviu), 
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whence Pv{u) = ^V(C°°)- Therefore, in order to show that the equahty 
= Py{u) holds, it suffices to show that = Py(C°^), i.e., that e V. 
Observe that for ah m G [p], is a Umit of the subsequence of ^'^ 
obtained by taking all the indices k such that (A; + 1 mod p) = m. Since 
Vm is closed, it follows that G Vm- Since this holds for all m £ [p], we 
deduce that eV. | 

The following is an immediate corollary. 

Corollary 8.1. The intersection V = ViD ■■■ DVp is not reduced to the — oo 
vector if and only if the cyclic projection algorithm, initialized by taking 
to be any finite vector u, converges to a non-{—oo) vector 5^°° (and then this 
vector is precisely = Pv{u) G FJ. I 

Applying this algorithm to the case of intersection of half-spaces, and 



using Theorem 5.1 we obtain the following algorithm to solve the system of 
inequalities (8.2), where A^B are p x n matrices with entries in Mmax. We 
have 

V = Hin---nHp, (8.4) 

where Hj is the half-space 

Hj := {x G K,^^ I Ajx > Bjx} Vj G [p], (8.5) 

with Aj := {Aji, . . . , Ajn) and Bj := {Bji, . . . , Bjn) denoting the jth. rows 
of A and B, respectively. Hence, by Theorem |5.1[ we obtain 

PhA^) =xA (BMji^)) G M.^,,,\fj G \p], (8.6) 

and thus, in particular, 

= PH.i^) = A (BMiiC')) VA. > 0, j :={k + l mod p) . 



Componentwise this means, by (1.8) and (5.2), that for each A; = 0, 1, . . . 
we have 

= PhM') = A {B,,\{A,{e)) yi G N , (8.7) 

where again j = (A; + 1 mod p) and Aj{^^) = . 

An alternative method to the cyclic projection technique is the following 
power algorithm, which is based on the observation that Ax > Bx if and 



only if X = B^Ax A x (see (2.33)). The latter fixed point problem can be 



solved by the iterative scheme 

ryO = u, 7]^+^ = B*At]^ a r/^ Vfc > , (8.8) 



with B* of (2.30). This method may be thought of as a generalization of 
the alternated projection algorithm of Butkovic and Cuninghame- Green 
which concerns the special case of the linear system Ay = Bz (the latter 
can be reduced to the former by setting x = (y, z) and suitably extending 
the matrices A and B). 

In order to compare the power algorithm with the cyclic projection algo- 
rithm we shall need the following "sandwich theorem" : 
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Theorem 8.2. Consider the linear system Ax > Bx. Let Vj^ and de- 
note the sequences generated by the power and cyclic projection algorithms, 
respectively, initialized with the same initial condition u. Then 

Pv{u) <r]^ yk>o . 



9) 



Proof. We shall use that the operator rj — )• {B'^Arj)j A r/^ is monotone. 
The first inequality follows from Theorem |8.1[ 
We now show that SJ' < r/^. By (2.30) we have 



{B*Au)j A Uj = Af^-^{-Bij +' (Aiu)) A Uj = {-B^ +' (Aiu)) A uj, 



for some i E [p]. Hence, using that ^ is non-increasing, (8.7) for k = and 



(5.2), it follows that 

e;<ej = {B,\iAe-'))j a < {bt^a.u) au, = v]. 

The inequality < r/'^ is obtained by induction. For A; = 1 it is already 
proved. Assume now that it holds for k replaced by /c — 1. Then, by (2.30) 
we have 



{B*Ar] 



A r] 



fc-i 



Bij+' (Ai7?'=-i)) Ar/ 



for some i G [p]. Then using that that is non- increasing and 

^p(fe-l)+i-l < ^p{k~l) < ^k-i^ 

it follows that 



< iBT-^'A,v'-')Av';-' = v';- 



^^^^^ 



The correctness of the power algorithm follows from the next result. 

Theorem 8.3. The sequence rj^ produced by the power algorithm initialized 
with rp = u is non-increasing and converges to Pv{u). Moreover, if u has 
finite integer entries, if V contains at least one finite vector, and if all the 
entries of the matrices A, B belong to ZD {— oo}, then, Vj"^ = Pv{u) for all 
m > n X d{x, V). 



Proof By (Q and (|8^, we have r]'' > > Pv{u) {k = 0,1,...). 

Hence the non- increasing sequence rf must have a limit, 77°°, such that 
u > r]°° > Pv{u). To show that the equality r]°° = -Py(n) holds, by the 
definition of Py it suffices to show that r]°° E V. But, passing to the limit 
for A: — )• 00 in (8.8) we obtain 

^00 ^ b^At]^ Ar]^, 



whence by (2.33), it fohows that Ar]"^ > Br]°°, that is, 7/°° G V. 
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Assume now that the conditions of the second part of the theorem hold, 
and let v denote a finite vector in V. Then, u > vX, for some finite scalar 
A, and so Pyiu) > vX is finite. 

Moreover, we already showed that Pviu) = 1]°" is the limit of the sequence 
of vectors rj'', and it follows from the construction of this sequence in (8.8) 
that for all k, the entries of rj^ belong to Z U {— oo}, as soon as the entries 
of A, B and u do. Therefore, Pv{u) S (Z U {— oo})", and since we observed 
that Pv{u) is finite, we must have Pv{u) G Z". Moreover, Vj^ G Z" since 
r]^ > Pv{u). 

We claim that 

Pv{u)\u = . (8.10) 

Indeed, the inequality Pv{u)\u > follows from Pyiu) < u. If we had 
Pv{u)\u > 0, then, we would have Pv{u)X < u for some A > 0, but then 
the vector w := Py(n)A > Py(n) would be such that w ^ V and w < u, 
contradicting the definition of Pv{u) as the maximal element with the latter 
properties. This proves (8.10). 
Hence, 

d{u,V) = d{u,Pv{u)) = {{u\Pv{u)){Pv{u)\u)y = {u\Pv{u))- . 



Since u and Py(n) are finite vectors, u\Pv{u) is finite, and so, using (1.3), 
we deduce from 

u{u\Pv{u)) < Pv{u) 

that 

u < Pviu){u\Pv{uyr . 

Hence, 

Pv{u) <u< Pviu)d{u,V) . 

In order to analyze the complexity of the algorithm, we return to the usual 
notation for the addition, and consider the function from to Z, 

ie[n] 

Observe that E{ri) > for all rj > Pv{u). Moreover, if ry™ = r/™"'"^, then, 
_ ]^yg|^ hold for all k > m, and so, rj"^ = lim^ r]^ = Pv{u). In addition, 
if m is the smallest index such that 77™ = 77™"*"^, then, the sequence of integer 
vectors if , . . . , "rf^ is strictly decreasing. In particular, at every step k < m, 
there it as least one coordinate i G [n] such that rj^ > ri^~^^. Thus, 

n X d{u, V) > E(rf) > E{r]^) > ■ ■ ■> E{r]"^) = . 

Since E{rp), . . . , E{r]"^) are integers, we deduce that m < n x d{u, V). | 

Corollary 8.2. The intersection V = ViD - ■ -DVp is not reduced to the —00 
vector if and only if the power algorithm, initialized by taking rf to he any 
finite vector u, converges to a non-{— 00) vector 77°° (and then this vector is 
precisely ri°° = Pviu) £ V)- t 
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The power algorithm (|8.8[) can be rewritten componentwise as 



^.11) 



This should be compared with the cyclic projection algorithm for Ax > Bx, 



that is, (8.7). Note that one step of the power algorithm requires 0{m) 



operations, where m is the total number of finite entries in the matrices A 
and B, whereas step i of the cyclic projection algorithm only requires 0{mi) 
operations, where rui is the total number of finite entries of the rows Ai and 
Bi. Since and Vj^ decrease to the same limit, Pv{u), the "sandwich" 
theorem |8.2| shows that the cyclic projection algorithm is always at least 
as fast as the power algorithm, since for the same effort of computation, it 
produces a closer upper bound of Py(n). Indeed, computing ^^'^^ requires 



an 0{k{mi + 
0{km) time. 



+ rup)) = 0{km) time, and computing rj also requires an 



Example 8.1. The following example shows that the cyclic projection al- 
gorithm may yield a speedup by a factor n, by comparison with the power 
algorithm. 

Consider the system of n — 1 inequations in n variables: 

Xi < -1 + Xn, X2 < -1 + Xi, . . . , Xn-l < -1 + Xn-2 ■ 

When n = 6, this corresponds to the following 5x6 matrices 



/ 



B 







V • • • • 



A 



-1 



V • 



-1 



-1 \ 



where — oo is represented by the "•" symbol. 

The cyclic projection algorithm, initialized with the zero vector, yields 
the sequence 

e = (o,...,of 
e = (-i,o,o,...,o)^ 
e = (-1,-2,0,..., of 



n-l 



-1, 



-(n-l),0)^ 



The algorithm converges in n steps, and every step takes 0(1) operations, 
which makes a total of 0(n) operations. Indeed, note that every row Bj and 
every row Aj have 0(1) entry equal to — oo, which implies that the update 
of ^ can be done in only 0(1) time. 
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The power algorithm, initiaUzed with the same vector, yields the sequence 

rf = (0,...,0f 

77^ = (-1,-1,... ,-1,0)^ 

rf = (-1,-2, -2,..., -2,0)^ 

rf = (-1,-2, -3, -3,..., -3, of 

rj^-^ = ,7" = (-l,-2,...,-(n-l),0f . 

The algorithm also converges in n steps, but every step now takes an 0{n) 
time, since computing every coordinate of B\{Ar]) requires a 0(1) time. 
Thus, the power algorithm requires a total of O(n^) operations, and the 
cyclic projection algorithm shows a speedup of n. 

In this example, the matrices are very sparse. One readily gets an example 
of full matrices with the same speedup by replacing every —00 entry by a 
value close enough to —00, which will not modify the sequences produced 
by the cyclic projection and by the power algorithm. Now, every step of the 
cyclic projection algorithm takes a 0{n) time, and every step of the power 
algorithm requires a O(n^) time. Hence, we keep a speedup of n. 

Remark 8.1. Theorem |8.3| gives a bound for the convergence time of the 
power and cyclic projection algorithms which is pseudo-polynomial, meaning 
that the convergence time is bounded by a polynomial expression in the 
integers constituting the input of the problem. To see this, let us recall the 
explicit expression of the projector, from |8j, 

Pv{u) = su-pvi{vi\u) , 

where {vi)i^i is an arbitrary generating family of V. A canonical choice of 
the generating family consists of representatives of the extreme rays of V; 
then, the explicit bound in [3l Proposition 10] shows that the finite entries 
of the vectors Vi, and so, d{u, V), are polynomially bounded in terms of the 
finite entries of the matrices A and B. 

Remark 8.2. The following simple example shows that the convergence 
time of both algorithms is actually only pseudo-polynomial. Assume that 
V is defined by the inequalities xi < max(0, — 1 -|- X2), X2 < xi, and let 
us initialize both algorithms with u = {k, k)'^, so that (0, 0)^ = Pv{u) and 
d{u, Pv{u)) = k. Then, it can be checked that both algorithms take k iter- 
ations to converge, whereas for a polynomial time algorithm, a number of 
iterations polynomial in log k would be required. Let us note in this respect 
that the problem of solving systems of max-plus inequalities is equivalent to 
solving mean payoff games (see [201 H] ) , and that the existence of a polyno- 
mial time algorithm for mean payoff games is an open question. 
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